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Page  76. 

ANALYSIS  OF  THE  CORRECTIVE  PROPERTIES  OF  REPEATED  AND  CASCADE  CODES. 

V.  V.  Zyablov. 

J  c 

Repeated  codes  have  long  ago  been  known^l].  In  this  work  Elayes 
shows  that  with  the  independent  errors  the  probability  of  erroneous 
decoding  can  be  done  how  conveniently  small  at  the  constant  velocity 
transmission,  if  length  and  dimension  of  the  repeated  code  unlimitedly 
grow.  The  connection  of  the  parameters  of  the  repeated  code  with  the 
parameters  of  its  subcodes  was  investigated  by  Slepian  [2].  Although 
since  then  left  many  works,  dedicated  to  the  analysis  of  the 
corrective  properties  and  advisability  of  applying  the  repeated  codes, 
their  corrective  properties,  especially  for  the  channels  with  the 
storage,  they  were  investigated  insufficiently. 

/ 

Cascade  codes  were  for  the  first  time  proposed  by  Forney  [3]. 

They  are  further  development  of  the  ideas,  placed  in  the  repeated 
codes . 

Fundamental  purpose  of  this  work  -to  show  that  for  real  channels, 
which  are  characterized  by  presence  of  errors,  inclined  to  grouping, 
a. id  by  variability  of  character  of  errors  in  time,  of  great  interest 
are  cascade  codes. 


1.  Cascade  codes. 
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In  the  book  of  Forney  [3]  is  given  algebraic  determination 
(construction)  of  cascade  codes  and  are  analyzed  corrective  properties 
by  their  way  of  determining  probabilities  of  their  erroneous  decoding 
with  independent  errors.  The  given  examination  of  the  cascade  codes 
differs  in  that: 

1)  are  given  somewhat  different  from  that  being  in  the  book  of 
odds  not  the  construction  of  the  cascade  codes; 

2)  the  analysis  of  the  corrective  properties  of  the  cascade  codes 
is  carried  out  by  the  determination  of  code  distance  of  the  binary 
code,  which  corresponds  to  cascade,  and  quantity  of  corrected 
subblocks. 

This  approach  makes  it  possible  to  consider  probability  of 
erroneous  decoding  during  application  of  cascade  codes  both  in 
channels  with  independent  errors  and  in  channels  with  grouped  errors. 

Page  77. 

We  will  call  code,  which  is  constructed  as  follows,  cascade: 

a)  k  binary  informational  symbols  are  divided/marked  off  into  k, 
subblocks  on  k,  of  binary  symbols  in  eachj 

b)  subblocks  of  length  kt  of  binary  symbols  are  considered  as 
elements  of  field  GF  (2*’,  and  are  coded  by  appropriate  (n,,  k,)-code  of 
Reed-Solomon  with  code  distance  of  d,=r,+l,  which  we  will  call  code  of 
second  step/stagej 

c)  each  symbol  of  code  of  second  step/stage  is  considered  as  k, 
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informat  ior.ai 
distance  of  d 


S* V\a1  r  1  ’  o  n  »■  K  ^  ^  f  »■* 

^  o  *.  a  4  *  w  a  a,  Aj.u*  ]  l  ii  i  r 

, ,  which  we  will  call  code  of 


lr  \  _  a  a  (J  <3  ^  U 

r>.  1  /  i^wus.  ft  ■*>  w*« 

first  stage. 


Process  of  this  coding  is  represented  in  Fig.  1.  Let  us  show 
that  the  binary  notation  of  all  words  of  that  obtained  by  such  form  of 
the  cascade  code  is  the  binary  linear  code  (by  binary  notation  it  is 
understood  the  consecutive  recording/record  n,  of  the  binary  words  of 
length  n,).  Since  the  binary  notation  of  all  words  of  the  cascade 
code  is  the  divisible  binary  code,  then  it  suffices  to  show  that  all 
its  words  form  group  during  the  addition  on  module  2,  i.e.,  the  sum  of 
any  two  words  forms  the  third  word  of  the  cascade  code. 


During  addition  of  two  words  of  cascade  code  on  module  2  we 
obtain  word  of  the  same  code,  since: 

1)  code  of  second  step/stage  linear  and  addition  in  field  GF  (2*>) 
is  additions  on  module  2j 

2)  the  code  of  first  stage  is  the  binary  linear  code,  i.e.  the 
sum  of  two  code  words  is  a  code  word  of  the  same  code. 


From  diagram  of  coding  we  directly  obtain  following  formulas  for 
parameters  of  cascade  code  through  parameters  of  its  subcodes: 


n  =  74  n*.  (1) 

v-M;,*  •'  -  - - —  '  - - 

B  =  i  =  RJl%.  - 

n  nin%  <  1  1 


Since  code  distance  of  code  of  second  step/stage  is  equal  tod,, 
then  there  is  minimum  ^ a  of  nonzero  words  of  code  of  first  stage  in 
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any  nonzero  word  of  cascade  code.  Any  nonzero  word  of  the  code  of 
first  stage  has  a  weight  d2.  Consequently,  the  minimum  weight  of  the 
cascade  code  (d)  is  defined  as 

^  ^  did*-  (2) 

Generating  matrix/die  (G)  of  binary  linear  code,  which 
corresponds  to  cascade,  can  be  obtained  as 

G  =  (Bkl  X  Gt)  x  Gk  =  Gt  x  Glt 

where  Bkl  xGt  —  G\  -  product  of  Kronecker  of  vector  of  column  Bkl  from 
elements  px  =  10....0,  p,  =  01 ...  0, ...,  p»,  =  00...1  to  generating  matrix/die  (G2) 
of  code  of  second  step/stage;  G*xG2  -  product  of  Kronecker  matrix/die 
G*  to  generating  matrix/die  (G2)  of  code  of  first  stage. 
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Fig.  1.  Diagram  of  coding  two-dimensional  cascade  code. 

Key:  (1).  q-nary  informational  symbols.  (2).  q-nary  checkout 

symbols.  (3).  Binary  checkout  symbols.  (4).  informational 
subblocks  (q-nary  symbols).  (5).  checkout  subblocks  (q-nary 
symbols) . 


Page  78. 


Let  us  illustrate  obtained  relationships/ratios  by  following 
examples . 


Let  as  code  of  first  stage  binary  linear  code  (7.3)  with  d2=4  be 
used,  and  as  code  of  second  step/stage  -  Reed-Solomon  codes  above 
field;  GF  (21);  (7.4)  with  d2*4,  (7.3)  with  d2  =  5  and  (7.2)  with  d2=6. 
Parameters  of  the  cascade  and  corresponding  shortened  codes  of 


Bose-Chaudhuri-Hocquenhem  (B-C-H)  with  n=49  are  given  in  the  table. 
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KacKfxnuB  xoa 

j  /_£)  Koa  B- 

H  — X 

: 

k 

1 

d 

! 

fc 

l  d  1 

HCyKOpORCHBUil 

fi)  *“* 

,  12 

16 

15 

14 

(63,29) 

9 

20 

9 

16 

(63,23) 

6 

24 

,  4 

21 

(63,18) 

;  Key:  (1).  Cascade  code.  (2).  Code  B-C-H.  (3).  unshortened  code. 

2.  Comparison  of  the  code  distances  of  the  repeated  and  cascade 
codes . 

Code  distance  of  repeated  code  is  always  equal  to  product  of  code 
distances  of  its  subcodes  [4].  Let  us  show  that  for  some  cascade 
codes  in  formula  (2)  both  the  equal  sign  and  the  sign  of  absolute 
inequality  can  occur. 

Let  us  consider  cascade  code,  in  which  as  code  of  first  stage 
binary  code  with  one  checkout  symbol  (dt*2),  is  used,  and  as  code  of 
second  step/stage  -  unshortened  code  of  Reed-Solomon  with  code 
distance  of 

dt  >  “2^1  +  1)  ^i(^»  —  !)•  (3)> 

For  example,  code  of  first  stage  (5.  4)  with  d»=2,  and  code  of 
second  step/stage  -  Reed-Solomon  code  (15.2)  with  d,«14. 

Let  us  show  that  for  such  codes  in  formula  (2)  inequality  sign 


occurs.  The  word,  which  consists  of  some  units,  i.e.,  (a*,  a* 
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a*,  a#),  where  a  -  primitive  element  of  field  GF  (2k<),  is  a  code  word  of 
Reed-Solomon  code  [5].  From  this  it  follows  that  any  nonzero  element 
of  field  GF  (2k‘)  in  Reed-Solomon  code  is  encountered  either  by  n,  or  it 
is  less  than  k,  times.  Actually,  let  us  assume  that  in  any  word 
element  (a1)  is  encountered  7  times.  Then  sum  on  the  module  for  this 
word  with  the  word  of  some  units,  multiplied  by  element  a1,  is  a  code 
word  and  contains  7  zero,  i.e.,  has  weight  w=n,~7.  On  the  other  hand, 
the  weight  of  any  word  of  Reed-Solomon  code  is  determined  by 
relationship/ratio  w£d2*n2-k2+l,  whence  it  follows  that 

*<**-*•  (4) 

In  field  GF  (2k*)  is  only  (k1+l)k,/2  nonzero  elements  weight  of 
which  in  binary  notation  it  does  not  exceed  two.  Each  of  these 
elements  in  the  code  word  is  encountered  not  more  than  than  k2-l 
times . 

Page  79. 

Consequently,  if  condition  (3)  is  satisfied,  then  among  dt  nonzero 
words  in  the  cascade  code  there  will  be  at  least  one  weights  three  or 
more,  i.e.,  in  formula  (2)  inequality  sign  will  occur. 

Following  example  shows  that  in  formula  (2)  equal  sign  can  occur. 
Let  as  the  code  of  first  stage  be  used  the  binary  linear  (n2, 
n2-l)-code  with  d2*2,  and  as  the  code  of  the  second  step/stage  - 
Reed-Solomon  code  (n2,  n2-l)  with  d2*2.  The  checkout  matrix/die  of 
the  code  of  the  second  step/stage  can  be  registered  in  the  following 
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form: 

Hz  —  !|a°s1a1 ...  ac-5||. 

It  is  not  difficult  to  ascertain  that  vector  (aB0...0a1)  is  a  code 
vector  of  the  code  of  the  second  step/stage.  The  weight  of  the 
corresponding  word  of  the  cascade  code  is  equal  to  four. 

Consequently,  in  formula  (2)  equal  sign  will  occur. 

Let  us  compare  code  distance  of  cascade  and  repeated  codes  with 
r2>l.  Let  the  code  of  first  stage  in  both  cases  is  one  and  the  same. 
For  any  binary  code  with  n2>8  and  r2>l  occurs  d2*<r2,  where  d2*  -  code 
distance  of  the  binary  code  of  the  second  step/stage.  Let  as  the  code 
of  the  second  step/stage  of  the  cascade  code  Reed-  Solomon  code  be 
used  with  d2*r2+l.  Consequently,  the  code  distances  of  cascade  (d<*>) 
and  repeated  of  the  codes  are  connected  with  the  following 
relationship/ratio: 

('*  +  1)  >  —  <*“)-  (5> 

From  relationship/ratio  (5)  it  follows  that  with  independent 
errors  cascade  code  is  always  better  than  repeated,  if  r2>l.  With 
r2*l  the  cascade  and  repeated  codes  can  be  identical. 

3.  Asymptotic  behavior  of  the  corrective  ability  with  the  independent 
errors  of  the  multidimensional  cascade  and  repeated  codes. 

They  call  relative  corrective  capability  of  code  for  independent 
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errors 

D  =  d;n.  (6> 

From  relationship/ratio  (2)  it  follows  that  relative  corrective 
capability  of  cascade  code  for  independent  errors  is  determined  by 
relationship/ratio 

D  >  d^djnj^  =  0) 

From' relationship/ratio  (7)  it  follows  that  for  repeated  code 
relative  corrective  capability  for  independent  errors  at  constant 
velocity  of  transmission  will  be  not  vanishing  functions  from  n,  then 
only  then,  when  relative  corrective  capabilities  for  independent 
errors  of  all  their  subcodes  are  those  not  vanishing  functions  from  nt 

Today  best  nonrandom  block  codes  are  codes  B-C-H,  for  which  at 
constant  velocity  of  transmission  we  have 

D  x  b/log  n,  (8) 

where  b  -  constant. 

Page  80. 

From  (7)  and  (8)  we  obtain,  that  relative  corrective  capability 
of  two-dimensional  repeated  coda  for  independent  errors  at  constant 
velocity  of  transmission  will  decrease  as 


•> 

ft1 


i; 
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Since  log  n=log  nj+log  Hj<log  n,.  log  n2<  then  the  asymptotic  behavior 
of  the  relative  corrective  capability  for  the  independent  errors  in 
the  two-dimensional  repeated  code,  constructed  on  the  basis  of  the 
codes  B-C-H,  is  worse  than  in  the  codes  B-C-H. 


Let  as  codes  of  first  degree  of  cascade  code  code  B-C-H  be  used, 
and  as  code  of  second  step/stage  -  unshortened  code  of  Reed-Solomon , 


for  which 


D,  =  ~^-1  ■  =  6,  =  const. 


Then  the  relative  corrective  capability  for  the  independent  errors  in 
cascade  code  (f>w),  constructed  on  the  basis  of  the  codes  B-C-H  and  the 
codes  of  Reed-Solomon,  is  defined  as 

£)(*)  >  DJ)t  =  Mi/log  n j. 

Taking  into  account  that  n^k^i  and  k^log  (n,+l)<log  n,  we  obtain. 


_ blbt  1 


\DW> 


log  log  n  —  log  Ri 


,  (U) 


Consequently,  two-dimensional  cascade  codes,  which  are 
constructed  on  basis  of  binary  codes  B-C-H  and  codes  of  Reed-Solomon, 
have  best  asymptotic  behavior,  than  codes  B-C-H. 


Let  us  consider  multidimensional  repeated  (cascade)  codes,  for 
which  code  distance  is  defined  as 


d = = iur< = n  «rn  rv 
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where  a,  =  d,/rt  =  f(R,)  and  1  <  a,  <  2  -  for  Reed-Solomon  code  and 
a,  «0,2-t-0,5  for  binary  linear  code.  Consequently,  the  code  distance  of 
the  multidimensional  code  is  determined  in  essence  by  capacity 
i>=II  ri-  From  work  [6]  it  follows  that  for  given  ones  A,  and  n  v 

4—1 

will  be  greatest,  if  rjkx  =*  rjk^  =  ...  —  rjkt  or ,  that  the  same, 


R1  =  =  ...  =  R,  —  Ili- 


Paqe  81. 


From  condition  (12),  taking  into  account  that 
J?  =  i  —  r/n  = 

4-1 

/?.=  !-  rjn{  =  (l >  1  ->■/("-  0  *• 


we  obtain 


rjnt  <  r/(ra  —  r)  s. 


Consequently,  the  relative  corrective  capability  for  the  independent 
errors  in  the  multidimensional  codes  can  be  evaluated  on  top  as 
follows : 


D  =  n  Di  <  II  «i  [r/(n  —  r)«r 

4-1  4-1 


From  relat ior.ship/ratio  (14)  it  follows  that  relative  corrective 
capability  for  independent  errors  in  cascade  and  those  in  repeated 
codes  rapidly  decreases  with  increase  in  their  dimension.  Therefore  a 
good  relative  corrective  capability  for  the  independent  errors  should 


DOC  =  87053401 


PAGE 


13 


be  expected  only  in  the  cascade  codes  with  small  dimensions. 

One  should  note  that  relative  corrective  capability  for 
independent  errors  is  although  very  important,  not  determining 
parameter,  since  S-dimensional  cascade  and  repeated  codes  with 
independent  errors  and  s->®  can  ensure  how  conveniently  small 
probability  of  erroneous  decoding  at  constant  velocity  of 
transmission. 

4.  Analysis  of  the  corrective  properties  of  the  sub-class  of  the 
cascade  codes. 

Let  us  consider  sub-class  of  two-dimensional  cascade  codes,  in 
which  as  code  of  first  stage  is  used  binary  linear  (k^l,  kj-code 
with  di«2,  and  as  code  of  second  step/stage  -  Reed-Solomon  code  with 
foundation  q  —  2*j  and  with  n,  ==  2*«  —  i,  d,  =»  n,  —  *,  +  1  =*  r,  +  1. 

Parameters  of  such  cascade  codes  are  determined  from  following 
formulas: 

»*(2‘*-l)  1),  '  . 

*  =  *1*1.  (15) 

d  >  =  2rt  +  2. 

Let  us  compare  relative  corrective  capability  for  independent 
errors  of  this  sub-class  of  cascade  codes  and  binary  codes  B-C-H.  The 
dependences  of  the  speed  of  transmission  (R)  on  the  relative 
corrective  capability  for  the  independent  errors  (D)  for  the  cascade 
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codes  and  the  codes  B-C-K  are  given  in  Fig.  2.  As  can  be  seen  from 
graphs,  the  cascade  codes  virtually  are  not  inferior  to  the  codes 
B-C-H  in  the  range  of  lengths  n=75-1016  and  speeds  of  transmission 
R=0.25-0.6,  but  they  sometimes  even  exceed  them. 

Let  us  consider  algorithm  of  decoding  of  this  sub-class  of 

« 

cascade  codes. 

With  decoding  of  codes  of  first  stage,  which  have  one  checkout 
symbol,  is  conducted  only  detection  of  errors.  Subblocks  with  the  odd 
number  of  errors  are  erased,  i.e.,  with  the  decoding  of  the  codes  of 
the  second  step/stage  they  are  considered  as  erasings. 

Page  82. 

With  decoding  of  codes  of  second  step/stage  (Reed-Solomon  codes) 
is  conducted  correction  of  errors  and  erasings,  for  example,  on 
algorithm,  proposed  in  work  [7]. 

With  this  algorithm  of  decoding  of  this  sub-class  of  cascade 
codes  code  distance  of  cascade  code  [8]  completely  is  realized,  and 
furthermore,  is  corrected  large  quantity  of  errors  of  multiplicity 
t>(d-l)/2.  In  the  same  time  the  algorithms  of  the  decoding  of  the 
codes  B-C-H,  as  a  rule,  do  not  make  it  possible  to  correct  the  error 
of  multiplicity  t>(d-l)/2.  Consequently,  the  cascade  codes  will 
ensure  with  the  independent  errors  the  large  correctness  of 
transmission,  than  the  binary  codes  B-C-H. 
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Let  us  consider  corrective  properties  of  sub-class  of  cascade 
codes  with  respect  to  errors,  which  are  grouped  into  one  or  several 
error  bursts. 


Let  us  determine  length  of  error  burst,  reliably  corrected  by 
data  by  sub-class  of  cascade  codes. 


^  j.  “»***»  "  ** 
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Fig.  2.  Dependence  of  speed  of  transmission  (R)  on  relative 
corrective  capability  for  independent  errors  (D).  a)  for  the 
cascade  codes  of  length  n=75  (1)  and  codes  B-C-H  of  lengths  n=63  (2) 
and  n*73  (3),  b)  for  the  cascade  codes  of  length  n*186  (1)  and  codes 
B-C-H  of  lengths  n*127  (2)  and  n=255  (3),  c)  for  the  cascade  codes  of 
lengths  n«441  (1)  and  n*1016  (2)  and  codes  B-C-H  of  lengths  n*551  (3) 
and  1023  (4). 


Page  83. 
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Let  the  subblocks  of  the  code  of  first  stage  be  consecutively/seriailv 

transmitted.  Then  any  burst  of  errors  of  the  length 

B  7 \rt/ 2]  —  (l'i  —  1),  (io) 

where  [X]  -  integer  part  X,  is  reliably  corrected,  since  it  will  be 
placed  either  in  [r,/2]  subblocks  and  then  it  is  reliably  corrected  by 
the  code  of  the  second  step/stage  or  in  ([r2/2]+l)  subblocks,  but  then 
in  two  subblocks  it  will  be  on  one  error,  i.e.,  they  will  be 
discovered,  and  combination  from  ta=[rJ/2]  -  1  errors  and  ra=2 
erasings  is  reliably  corrected  by  the  code  of  the  second  step/stage. 

For  number  of  checkout  symbols  of  linear  code,  which  corrects 
burst  of  errors  of  length  b,  if  b/n  is  not  very  small,  are  used 
following  simple  evaluations:  2b£r£3b  or  0 . 33sb/rS0 . 5 . 

Ratio  B/r  for  sub-class  of  cascade  codes  and  speeds  of 
transmission  R=0.25  and  R=0.5  in  question  is  given  in  Fig.  3.  From 
the  graphs  it  is  evident  that  the  sub-class  of  the  cascade  codes  in 
question  is  close  to  the  optimum  linear  codes,  which  correct  the 
single  error  burst. 

Let  us  consider  possibility  of  correction  of  several  error 
bursts.  Assume  that  in  code  combination  of  the  cascade  code  after  its 
transmission  along  the  channel  appeared  7  the  error  bursts.  Any  burst 
of  errors  of  length  5,  will  strike  not  more  than  it  subblocks  when 

li  =  I  -Bj/nl  [  +  1, 

where  ]  X  [  -  the  smallest  whole  number,  greater  or  equal  to  X.  On 
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the  other  hand,  y  the  error  bursts  will  be  corrected,  if 

T 

i-i 

Carrying  out  reasonings,  analogous  to  those,  which  occurred 
during  determination  of  single  reliable  corrected  error  burst,  we 
obtain  following  condition  for  sum  of  lengths  of  packets,  under  which 
they  are  reliably  corrected: 

Y 

2jBi<max{n1lrl/2]-(2r-l)(*1-l),  [rj 2]}.  (17) 

Dependence  of  total  length  of  reliably  corrected  error  bursts  on 
number  of  error  bursts  for  cascade  code  with  n=1016  and  R=0.25  is 
given  in  Fig.  4. 

Let  us  note  that  condition  (17)  assigns  lower  boundary  for  sum  of 
lengths  of  reliably  corrected  bursts  of  errors,  allocation  of  lengths 
of  which  can  be  arbitrary.  Since  allocation  of  lengths  does  not  have 
vital  importance,  but  have  a  value  only  a  number  of  error  bursts  and 
their  total  length,  then  the  codes  with  such  corrective  properties 
will  be  good  for  the  channels,  where  the  errors  are  inclined  to  the 
grouping,  but  allocation  of  the  lengths  of  the  error  bursts  carries 
random  character. 

Algorithm  of  decoding,  which  realizes  corrective  properties  of 
cascade  codes  examined  with  respect  to  errors,  which  are  grouped  into 
one  or  several  packets,  the  same,  as  for  correction  of  independent 
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errors.  The  analysis  of  the  corrective  properties  of  the  sub-class  of 
the  cascade  codes  and  by  the  error  burst  was  produced  under  the 
condition  of  their  reliable  correction. 

Page  84. 

Actually  with  this  algorithm  of  decoding  the  corrective  properties  of 
the  sub-class  of  the  cascade  codes  and  to  the  error  bursts  will  be 
above  due  to  the  correction  with  a  certain  probability  of  error  bursts 
with  the  larger  sum  of  lengths,  than  it  is  guaranteed  by  condition 
(17).  Actually,  assume  that  the  error  bursts  affected  /  subblocks. 
After  the  decoding  of  the  codes  of  first  stage  the  subblocks  with  the 
odd  combination  of  errors  will  become  erasings.  If  in  ta  the 
subblocks  are  the  not  detected  by  the  code  first  steps/stages  of 
error,  and  in  r,*/-t,  -  subblocks  -  the  detected  errors,  then  when 
2ta  +  Tj,<;r^  the  decoding  will  be  carried  out  correctly.  Consequently, 
the  probability  of  incorrect  decoding  (P,(/)),  when  errors  occur  into 
/>ra/2  subblocks,  is  equal  to  the  probability  of  the  fact  that  the 
errors  are  discovered  less  than  in  2(/-[ra/2])  subblocks.  Let  pu  be 
probability  of  the  undetected  error  after  the  decoding  of  the  codes  of 
first  stage  (if  errors  are  independent  or  errors  within  the  packet  are 
independent,  then  pltS0.5).  Then  we  obtain  the  following  expression 
for  the  probability  of  the  incorrect  decoding,  when  ra/2S/sra: 

^>»(^)==  2  (i  ~  Pn)1' 

iH 

Fig.  5  gives  upper  bound  of  probability  of  incorrect  decoding  as 
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functions  of  ratio  1/ r,  for  cascade  code  with  n=1016  and  R=0.25.  From 
the  graph  it  is  evident  that  with  small  disturbances  of  condition  (17) 
probability  of  incorrect  decoding  is  small. 
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Fig.  3  .  Fig.  4. 

Fig.  3.  Dependence  of  ratio  of  length  of  corrected  error  burst  to 
number  of  checkout  symbols  (B/r)  on  length  of  cascade  codes  (n)  for 
speeds  of  transmission  R=0.5  (1)  and  R=0.25  (2)  (a  and  b  -  border  for 
optimum  linear  codes). 

Fig.  4.  Dependence  of  total  length  of  reliably  corrected  bursts  of 
errors  (25^  on  number  of  bursts  of  errors  (7)  for  cascade  code  with 
n=1016  and  R=0.25. 


Fig.  5.  Upper  bound  of  probability  of  incorrect  decoding  (POm(0)  as 
function  of  ratio  of  number  of  subblocks  with  errors  to  number  of 
checkout  symbols  of  code  of  second  step/stage  (// r,)  for  cascade  code 
with  n*1016  and  R=0.25. 


Page  85. 
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Conclusion. 

Work  examines  corrective  properties  of  cascade  and  repeated 
codes.  The  conducted  investigations  showed  that: 

1)  the  cascade  codes  have  the  best  corrective  properties,  than 
the  repeated  codesj 

2)  the  corrective  properties  of  the  cascade  and  repeated  codes 
deteriorate  with  an  increase  in  their  dimension^ 

3)  the  two-dimensional  cascade  codes,  constructed  from  the  binary 
codes  B-C-H  and  the  codes  of  Reed-Solomon,  have  asymptotically  best 
parameter  D=d/n,  than  the  binary  codes  B-C-H. 

Analysis  of  corrective  properties  of  sub-class  of  cascade  codes, 
in  which  in  first  stage  are  used  codes  with  one  checkout  symbol  -  and 
in  second  step/stage  -  unshortened  codes  of  Reed-Solomon,  it  shows 
that  in  the  range  of  lengths  n=75-1016  and  speeds  of  transmission 
R=0.25-0.6  they  virtually  are  so  good  for  independent  variables, 
errors  as  binary  codes  B-C-H,  and  with  error  bursts  their  corrective 
properties  are  close  to  optimum.  The  fact  that  these  codes  are 
efficient  both  for  the  channels  with  the  independent  errors  and  for 
the  channels  with  the  error  bursts,  and  the  algorithm  of  decoding, 
which  realizes  the  most  fully  corrective  properties,  with  any 
character  of  errors  one  and  the  -»c*me,  makes  with  their  especially 
valuable  for  the  real  channels,  in  which  the  character  of  errors 
varies  in  the  time  randomly. 
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ALGORITHMS  OF  THE  STEP  BY  STEP  DECODING  OF  THE  REPEATED  AND  CASCADE 

CODES . 

V.  V.  Zyablov. 

v  Repeated  and  cascade  codes  can  successfully  be  used  both  in 
channels  with  independent  errors  and  in  channels  with  errors,  inclined  v 

c  * 

to  grouping  £l ,  2],  Its  decoding  is  one  of  the  principal  problems 
during  the  application  of  any  code.  In  the  general  case  the  decoding  v 
of  the  repeated  and  cascade  codes  is  simplified  due  to  their  step  by 
step  decoding,  i.e.,  first  are  decoded  the  codes  of  first  stage,  and 
then  the  second.  However,  the  analysis  of  that  how  the  corrective 
properties  of  the  repeated  or  cascade  code  fully  with  this  decoding  V 
are  realized,  in  the  literature  is  absent.  The  algorithm  of  step  by 
step  decoding,  proposed  by  Elayson  [3],  historically  was  the  first 
algorithm  of  the  decoding  of  the  repeated  code,  '•fhe  most  general/most 
common  algorithm  of  the  decoding  of  the  repeated  and  cascade  codes  is 
the  algorithm  of  decoding  on  generalized  code  distance,  proposed  by 
Forni  [4]. 

In  work  analysis  of  realizable  corrective  properties  with 
different  simple  algorithms  of  step  by  step  decoding  of  repeated  and 
cascade  codes  with  independent  errors  is  conducted.  The  generalized 
algorithm  of  step  by  step  decoding,  which  the  completely  realizes  code 
distance  of  the  repeated  or  cascade  code  is  actually  the 


9* 

DOC  =  87053402 


PAGE 


disintegration  of  the  best  algorithm  of  decoding  in  terms  of  the 
generalized  code  distance  on  they  are  simple  the  algorithms  of  step  by 
step  decoding,  is  developed/processed. 


SIMPLE  ALGORITHMS  OF  STEP  BY  STEP  DECODING. 

Algorithm  of  step  by  step  decoding,  with  which  code  of  first  step 
is  used  for  correction  of  all  errors  to  multiplicity  i  and  detection 
of  all  remaining  errors  (combination  of  code  of  first  stage  with 
discovered  errors  it  is  erased) ,  and  code  of  second  step/stage  is  used 
for  correction  of  errors  and  erasings  in  word  decoded  by  code  of  first 
stage  of  code  of  second  step/stage,  we  will  call  simple  and  let  us 
designate  At. 


Let  us  consider  smallest  multiplicity  of  error,  which  can  be  not 
corrected  with  algorithm  of  decoding  Ai,  where  i=0,  1,  2,  [(  dx-l 
)/2] . 

Page  87. 

Let  dx  -  code  distance  of  code  of  first  stage,  and  d,  -  code 
distance  of  code  of  second  step/stage,  then  cascade  code  has  code 
distance  of  [5] 

>  didt.  ,  . 


Subsequently  we  will  speak  only  about  cascade  codes,  since 


repeated  code  is  special  case  of  cascade  code  [5]. 
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In  the  case,  when  in  relationship/ratio  (1)  equal  sign  occurs, 
highest  multiplicity  of  reliably  corrected  by  cascade  code  error  is 
determined  by  relationship/ratio 


For  determining  smallest  multiplicity  of  error,  which  can  be  not 
corrected  with  algorithm  of  decoding  let  us  introduce  function 
A  ( X )  =  min  {X  (<  +  /)  +  Y  &  -  i)}  Ldhcr*  X  +  2 Y  + I  >d (3) 
where  X  -  number  of  erased  subblocks  of  code  of  first  stage,  after  its 
decoding;  Y  -  number  of  subblocks  of  code  of  first  stage  with  errors 
after  coding  of  code  of  first  stage;  /« (X)  -  smallest  multiplicity  of 
error,  which  can  be  not  corrected  with  algorithm  of  decoding  a„  if 
erasing  X  subblocks  after  decoding  of  code  of  first  stage  occurs. 

For  explanation  of  aforesaid  let  us  consider  following  example. 
Let  there  be  the  cascade  code,  in  which  as  the  code  of  first  stage 
binary  cyclic  code  (23,  11)  with  d»»8  is  used,  and  as  the  code  of  the 

i 

second  step/stage  -  shortened  code  of  Reed  -  Solomon  (31,  15)  with 
d,«17  above  field  GF{211).  In  accordance  with  (2)  this  code  can 
reliably  correct  all  errors  up  to  multiplicity  _  67 

Let  t,  be  highest  multiplicity  of  reliably  corrected  error  with 
algorithm  of  decoding  a,,  then  we  have 
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t,  —  mm  /,  (X)  -  1  o  *r  X*r  J..  /  -  . 

*  "  ■  <rj. 

From  formulas  (3)  and  (4)  we  obtain  t,=16,  t2=33,  ta=50,  tj=43. 

Plotted  functions  / i  for  i=0,  1,  2,  3  are  given  in  figure.  Thus, 
we  see  that  1 1  <.tk  with  any  i.  On  the  other  hand,  best  is  algorithm 
A,,  with  which  f,  (X)  is  virtually  parallel  to  axis  X.  Let  us  show 
that  with  any  values  of  d2  and  d2  graphs  /<  (X)  are  similar 
represented  in  the  figure. 
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Dependence  of  the  smallest  multiplicity  of  irremediable  error  on  a 
number  of  erased  with  the  decoding  of  the  code  of  first  stage 
subblocks  for  different  simple  algorithms  of  step  by  step  decoding  in 
the  cascade  of  the  code  with  dx*8  and  d,*17. 


Page  88. 

(i )  (Ai 

IlycTi.  2  (f  +  1)  «  (d*  —  l),  t.  e.  i0ni  —  l(^i  2)/3),  Toraa 

j  .  T,  _  \  l(di  +  D/3J  it  *  -  it  mod  2.  (5) 

/o8r(A)_l[(dl+  l)/31(d.+  l)  mod2. 


Key:  (1).  Let.  (2).  then.  (3).  with. 

Prom  relationship/ratio  (5)  it  follows  that  when  *=fon T 
function  /,  (X)  oscillates  relative  to  straight/direct,  parallel  axis 
X. 


U/  .  (jj 

nycTJ.  i  =  ionr  4-  },  r«e  —  iom <  /  <  [(A  —  i)/2]  —  /onT,  Torja 

(V 

i  r  §  i  i  _ i _  *  if  «  i  _  m  ir/i  — 

/<  (X) 


{ 


/out  ( X)  +  /  [(3X  —  d|)/2]  mfe  X  =  rf,  mod  2, 
'*m{X)-,r1(3X-dt-  t)/2  X#=d,  mod  2. 


(6) 


Prom  relationship/ratio  (6)  it  follows  that  when  i 


tt  -  min /,  ( X)  -  1  <  t0„  =  min /OOT  ( X)  -  1 . 


(7) 


Prom  obtained  results  we  have,  that  algorithm  of  step  by  step 
decoding  At ,  where  i»(dx-2)/3f  ensures  greatest  highest  multiplicity  of 
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step  by  step  decoding  and  that 


-  /* 


GENERALIZED  ALGORITHM  OF  STEP  BY  STEP  DECODING. 


Generalized  algorithm  of  step  by  step  decoding  is  complicated 
algorithm  of  step  by  step  decoding,  i.e.,  is  combination  of  several 
simple  algorithms  of  step  by  step  decoding.  In  the  particular  case 
the  generalized  algorithm  of  step  by  step  decoding  is  a  combination  of 
all  simple  algorithms  of  step  by  step  decoding.  The  block  diagram  of 
the  generalized  algorithm  of  step  by  step  decoding  is  represented 
below.  This  algorithm  consists  of  the  following: 

the  combination  of  the  cascade  code  accepted 
consecutively/serially  is  decoded  for  each  simple  algorithm  A,,  where 
i-0.1,  [ (d1-l)/2]*7j 

fcfter  decoding  of  combination  accepted  through  algorithm  At  is 
located  distance  of  combination  accepted  from  that  obtained  ( dt ),  if 
code  combination  of  cascade  code  was  obtained  as  a  result  of  decoding. 
Otherwise  the  word,  obtained  as  a  result  of  decoding  on  algorithm  Ai, 
is  rejected^ 

obtained  distance  dt  is  equal  with  tk  =  [(d*  — 1)/21  and,  if  d,<tv 
decoding  ceases,  and  word,  obtained  as  a  result  of  decoding  on 
algorithm  A t,  is  accepted  for  unknown;  otherwise  decoding  is  continued. 

if  J,  >  then  obtained  distance  is  equal  with  d„  where  <7.  is 
minimum  of  all  distances,  obtained  with  previous  decodings  of  this 
combination  accepted  on  simple  algorithms  of  step  by  step  decoding. 
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in  the  case  code  combination,  obtained  with  algorithm  .4,, 

is  memorized,  and  d,  is  substituted  on  dt.  Otherwise  code  combination 
obtained  with  algorithm  Ait  is  rejected. 

Page  89. 

decoding  ceases,  and  for  unknown  word,  which  has 
distance  d,  is  accepted. 

Generalized  algorithm  of  step  by  step  decoding  guarantees  selection  of 
best  of  simple  algorithms  for  step  by  step  decoding  of  cascade  code  for  this 
combination  of  errors.  We  shall  prove  that,  although  for  any  simple  algorithm, 
for  step-by-step  decoding  of  a  cascode  code  the  highest  rate  of  reliably 
corrected  errors  is  less  than  is  guaranteed  by  code  distance  of  cascade  code, 
generalized  algorithm  of  step  by  step  decoding  makes  it  possible  to  correct  all 
errors  up  to  the  rate  guaranteed  by  code  distance,  if  d=did2. 


m 


DOC  =  87053402 


PAGE 


31 


i  Hcnpa&neiuie  KoaoM 
.  —  rfpu/%|i  o?uh T-OK 

I  ao  Kpi»7HOC?r.  \  »l 

oOHai'yjKonue  ocTa;ibBUX  I 


-&  n^i*'*nTan  i 
I  KOmOMHciUM  fl  I 


m 


^  IlcnpaB.icniT  ohimOok  » 
CTltpaHlU!  K030M  BTOrOil 
cttikhli 

I 

_ i _ 

u.)  CiiCTcMa  RMeeT 
eanscTnciiHOC  pememie 


(J1  lonpeaenfHFf  d{ 


d,S  -  i 


BhUaia  acKoan- 
POBaHHOS 
KOUCBliailHB 


UJ  • - 

HOT  | 
_ 1 

09  \ 

OrCpacwBnFBC 

noiiy^eHHofl 

HOMGiinauuu 


aanomiHaHiie 

KOMGUHaUHK 

■  <*»  ■  r  di 


»""e  -1-!  *„  >  n 

tio8  •  *  ^ 


®  HfT* 


Bi.ime  o6Hapr*»MTiiorB, 
ao  BeBcnpabJiHcBoro 

eoseraHHH  omsifoK 


'-’.'I 

•'<V< 

«V: 

y* 


Key:  (1).  yes.  (2).  no.  (3).  Combination  accepted.  (4). 

Correction  by  code  of  first  stage  of  errors  to  multiplicity  i 
detection  of  rest.  (5).  Correction  of  errors  and  erasings  by  code  of 
second  step/stage.  (6).  System  has  unique  solution.  (7). 
determination.  (8).  Output  of  decoded  combination.  (9).  Memorizing 


of  obtained  combination  and 


.  (10).  rejection  of  obtained 
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Let  error  of  multiplicity  t  occur,  so  that  is  correct 


d  =  <M,  >  2 1. 


On  the  other  hand,  the  error  of  multiplicity  t  can  be  registered  in 
the  following  form: 

«  =  1/X'i.  d) 

;=i 

de  X/  -  number  of  subblocks  of  the  code  of  first  stage  with  the 
errors  of  multiplicity. 


From  relationships/ratios  (8)  and  (9)  we  obtain 

diJt  >  2  2  /-'r  Oo) 

/-i 

If  error  of  multiplicity  t,  which  satisfies  (8)  and  having 
allocation  on  subblocks,  given  by  relationship/ratio  (9),  can  be 
corrected  with  any  simple  algorithm  A then  with  generalized  algorithm 
of  step  by  step  decoding  of  cascade  code  word,  accepted  with  this 
combination  of  errors,  will  be  decoded  correctly.  Consequently,  it  is 
necessary  to  demonstrate  that  from  the  validity  of  relationship/ratio 
(10)  follows  validity  of  at  least  one  of  the  following  7+1 
inequalities: 

<*,>*2*1+2  2  */•  . 7).  (in 

H 1+* 
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Let  dx  =2,7+1,  then  all  relationships/ratios  (11),  except  latter, 
be  multiplied  by  two,  we  store/add  up  their  left  and  right  sides  and, 
after  leading  conversions,  we  obtain 

d  I — 1  TT  , 

(2r+l)rf,=-rf,d,  >2  2  ^  +  2(27  4-1)  2  (12) 

=1  ;=J, 

Let  ^  =  2y  4-  2,  then  all  relationships/ratios  (11)  be  multiplied 
by  two,  we  store/add  up  their  left  and  right  sides  and,  after  leading 
conversions,  we  obtain 

di— t  n, 

(2r  +2 )d,  =  d,d,  >  2  2  i*i  +  2  (2r  4-2)2  *i-  ( 1 2) 

j=l  ;=di 

From  validity  of  relationship/ratio  (10)  validity  of 
relationships/ratios  (12)  and  (13)  follows,  while  from  validity  of 
latter  validity  of  at  least  one  of  relationships/ratios  (11)  follows. 

ALGORITHMS  OF  THE  STEP  BY  STEP  DECODING  OF  THE  CASCADE  CODES  DURING 
THEIR  APPLICATION  IN  THE  REAL  CHANNELS. 

As  it  follows  from  work  [6],  error  in  standard  telephone  channels 
is  far  from  independent.  The  model  of  the  source  of  errors,  proposed 
in  work  [6],  and  well  conforming  with  experimental  data,  is 
characterized  by  the  following: 

errors  in  channel  are  inclined  to  the  grouping,  i.e.,  errors  are 
grouped  into  the  packets,  and  the  error  bursts  are  grouped  into  the 
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cha ins /net works . 

errors  in  packets  are  independent,  and  packets  in  chains/networks 
are  independent. 

probability  of  error  within  error  burst  is  close  to  0.5. 

Page  91. 


If  average/mean  length  of  error  burst  is  commensurate  with  length 
of  subblock,  then  are  probable  following  distortions  of  subblocks: 
subblock  out  of  error  burst, 
subblock  wholly  within  error  burst, 
error  burst  begins  in  this  subblock, 
error  burst  is  finished  in  this  subblock, 
one  packet  begins,  and  it  is  finished  with  other  in  this 
subblock. 

error  burst  wholly  lies/rests  at  this  subblock. 

The  first  of  distortions  examined  does  not  require  corrections, 
but  the  secondly  correction  of  errors,  as  a  rule  is  thoughtless.  With 
the  decoding  of  the  codes  of  first  stage  in  the  remaining  cases  it  is 
expedient  either  only  to  discover  errors  or  to  correct  the  single 
error  burst  and  to  discover  remaining  errors.  With  this 
relationship/ratio  of  length  the  burst  of  errors  and  length  of 
subblock  is  assumed  the  following  algorithm  of  decoding  B,: 

first  iteration  -  codes  of  first  stage  are  used  only  for  the 
detection  of  errors,  and  the  codes  of  the  second  step/stage  -  for  the 
correction  of  errors  and  erasings. 
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second  iteration  -  codes  of  first  stage  are  used  for  correction 
of  error  bursts,  and  codes  of  second  step/stage  -  for  correction  of 
errors  and  erasings. 

if  code  combinations  were  obtained  in  both  iterations,  then  for 
unknown  is  accepted  that,  which  from  that  accepted  differs  in  smaller 
number  of  subblocks.  If  only  in  one  of  the  iterations  was  obtained 
code  combination,  then  it  is  accepted  for  unknown. 

Algorithms  of  step  by  step  decoding  with  inclined  to  grouping 
errors,  just  as  with  independent  errors,  can  be  decomposed  into  simple 
and  complicated  algorithms  of  step  by  step  decoding.  In  this  case  by 
simple  algorithm  of  step  by  step  decoding  with  the  errors  inclined  to 
the  grouping  is  understood  this  algorithm  of  the.  step  by  step 
decoding,  when  the  code  of  first  stage  corrects  the  i-fold  error 
bursts  and  it  discovers  the  remaining  errors  (combination  of  the  code 
of  first  stage  with  the  discovered  errors  it  is  erased),  and  the  code 
of  the  second  step/stage  is  used  for  the  correction  of  errors  and 
erasings.  This  algorithm  of  step  by  step  decoding  we  will  designate 
C(  (i-0,  1,  2,  ...).  In  particular,  algorithm  C,  always  coincides 
with  algorithm  A,. 

By  complicated  algorithm  of  step  by  step  decoding  at  inclined  to 
grouping  errors  we  will  also  understand  combination  from  simple 
algorithms  of  step  by  step  decoding.  In  particular,  algorithm  Bx  is  a 
complicated  algorithm  of  step  by  step  decoding,  since  it  is  the 
combination  of  algorithms  C,  and  Ct. 
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Following  algorithm  of  decoding  3,  will  be  analog  of  generalized 

algorithm  of  step  by  step  decoding  with  errors,  inclined  to  grouping,: 

first  iteration  -  codes  of  first  stage  are  used  for  detection  of 
errors,  and  codes  of  second  step/stage  -  for  correction  of  errors  and 
erasings. 

second  iteration  -  codes  of  first  stage  are  used  for  correction 
of  single  burst  of  errors  and  detection  of  remaining  errors,  and  codes 
of  second  step/stage  -  for  correction  of  errors  and  erasings. 

third  iteration  -  codes  of  first  stage  are  used  for  correction  of 
two  bursts  of  errors  and  detection  of  remaining  errors,  and. codes  of 
second  step/stage  -  for  correction  of  errors  and  erasings  and  so  forth 
to  multiplicity  of  maximum  reliably  corrected  error; 

from  code  combinations,  obtained  on  different  iterations,  for 
unknown  is  accepted  that,  which  differs  from  that  accepted  in  smallest 
number  of  subblocks. 

About  advisability  of  applying  these  algorithms  of  decoding  it  is 
possible  to  say  following:  algorithm  C,  is  advisable  with  length  of 
cascade  code  on  the  order  of  hundreds  and  thousands  of  binary  symbols 
and  following  relationship/ratio  between  lengths  of  subcodes  n,*a  log 
n,;  Bx  -  with  length  of  cascade  code  on  the  order  of  hundreds  and 
thousands  of  binary  symbols  and  following  relationship/ratio  between 
lengths  of  subcodes  »h  *  on,;  b,  -  for  three-dimensional  cascade  codes 
and  cascade  codes  of  higher  dimensions  or  when  length  of  code  is  so 
great,  that  one  or  several  chains/networks  wholly  are  placed  in  code 
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comb i na t i on . 
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